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Section 16 



Convergence on metric spaces. 
Portmanteau Theorem. Lipschitz 
Functions. 



Let {S, d) be a metric space and B - a, Borel a-algebra generated by open sets. Let us recall that P„ ^ P 
weakly on B if 

J fdFn^ J fdF 

for all / e Cb{S) - real- valued bounded continuous functions on S. 

For a set A C S, we denote by A the closure of A, int A - interior of A and dA = A \ intA - boundary 
of A. A is called a continuity set of P if ¥{dA) = 0. 

Theorem 36 (Portmanteau theorem) The following are equivalent. 

1. P„ ^ P weakly. 

2. For any open set U C S, liminf „^oo Vn{U) > V{U). 

3. For any closed set FCS, limsup„^<^ P„(F) < V{F). 
4- For any continuity set A o/P, lim„^ooPn(^) = P(^). 

Proof. 

1=J>2. Let U be an open set and F = U". Consider a sequence of functions in Cb{S) 

fm{s) = mm{l, md{s,F)) 
such that fm{s) T Ic/(s)- (This is not necessarily true if U is not open.) Since P„ P, 

Pn(f/) > / fmdPn ^ / frndV as 71 ^ oo and liminf P„(C/) > / frndF. 
J J J 

Letting m — > oo, by monotone convergence theorem. 

liminf P„([/) > / ludF = V{U). 

n— ^oo J 

2<S=>3. By taking complements. 
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2, 3=>4. Since intA is open and A is closed and intA C A, by 2 and 3, 

P(intA) < liminf P„(intA) < limsupP„(A) < ¥{A). 

If ¥{dA) = then P(A) = P(inty4) = P(^) and, therefore, limP„(A) = ¥{A). 

4=>1. Consider / e Ci){S) and let Fj^ = {s G 5 : /(s) = y} be a level set of /. There exist at most 
countably many y such that ¥{Fy) > 0. Therefore, for any e > we can find a sequence ai < . . . < ajv such 
that 

max(afc+i - Ofe) < e, P(^;^) = for all fc 
and the range of / is inside the interval (ai, ajv)- Let 

-Bfc = {s e S : flfe < /(s) < ttfe+i} and /^(s) = ^ afcl(s e Bfc). 

Since / is continuous, dBk C F^, U and ¥{dBk) = 0. By 4, 



/ fedFn = ^afcP„(Bfc) ^ ^afeP(Sfc) = / /,dP. 
k k 



Since, by construction, |/e(s) — /(s)| < e, letting £ ^ proves that J fdFn J fdF. 
Lipschitz functions. For a function / : S ^ M, let us define a Lipschitz semi-norm by 

xj^y d[x, y) 

Clearly, ||/||l = iff / is constant so ||/||l is not a norm. Let us define a hounded Lipschitz norm by 

II/I|bl = ||/||l + ||/IU, 

where ||/||cx, = sup^gg |/(s)|. Let 

BL{S,d) = [f:S-^R : ||/||bl<oo} 
be a set of all bounded Lipschitz functions. 

Lemma 32 If f,g € BL{S,d) then fg e BL{S,d) and \\fg\\BL < ||/||bl||5||bl. 

Proof. First of all, \\fg\\oo < 11/11001151100- We can write, 

\f{x)g{x) - f{y)g{y)\ < \f{x){g{x) - g{y))\ + \g{y){f{x) ~ f{y))\ 
< ||/||oo||5l|Lc;(a;,t/) + ||sf||oo||/||Lc;(x,i/) 

||/5||bl < ll/lloolMloo + II/IIooIMIl + IMIooII/IIl < ||/||bl|MIbl. 

Let us recall the notations a V 6 = max(a, b) and a Ab = min(a, b) and let * = A or V. 

Lemma 33 The following hold. 

1- ll/i * • • • * fk\\h < maxi<j<fc ||/i||L- 
^- ll/i * • •• * /fellBL < 2maxi<i<fc ||/i||BL- 
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Proof. Proof of 1. It is enough to consider k = 2. For specificity, take * = V. Given x,y € S, suppose that 

/iV/2(a;)>/iV/2(2/) = /i(2/). 

Then 

I/.VAM-/,VAW| = /.VAW-AVA(») < {^Z^, i'.illf*' 

< ll/l||LV||/j||L<i(l,!/). 

This finishes the proof of 1. 

Proof of 2. First of all, obviously, 

ll/i * • • • * /felloo < niax ||/j||oo- 

l<i<k 

Therefore, using 1, 

ll/i * •• • * //cIIbl < max||/j||oo + max||/i||L < 2max ||/i||BL- 



Theorem 37 (Extension theorem) Given a set A C S and a bounded Lipschitz function f G BL{A,d) on 
A, there exists an extension h G BL{S, d) such that 

f = h on A and ||/i||bl = ||/||bl- 

Proof. Let us first find an extension such that = We will start by extending / to one point 

x & S\A. The value y = h{x) must satisfy 

\y-f{s)\<\\f\\j^d{x,s) for all s€A 

or, equivalently, 

inf (/(s) + \\f\\Ld{x,s)) >y> sup(/(s) - \\f\\i^d{x,s)). 
Such y exists iff for all si, S2 € A, 

f{Sl) + \\f\\Ld{x,S,) > /(S2) - \\f\\i^dix,S2). 

This inequality is satisfied because by triangle inequality 

f{S2) - f{si) < ||/||Ld(si,S2) < \\f\\L{d{si,x) + d{S2,x)). 

It remains to apply Zorn's lemma to show that / can be extended to the entire S. Define order by inclusion: 

/i -< /2 if /i is defined on A-^, /2 - on A2, Ai C A2, fi = /2 on Ai and ||/i||l = ||/2||l- 

For any chain {fa}, f — [j fa >- fa- By Zorn's lemma there exists a maximal element h. It is defined on the 
entire S because, otherwise, we could extend to one more point. To extend preserving BL norm take 

/.' = (/iA||/|U)V(-||/|U). 

By part 1 of previous lemma, it is easy to see that ||/i'||bl = ||/||bl- 

□ 

Stone- Weierstrass Theorem. 

A set ^ C S is totally bounded if for any e > there exists a finite e-cover of A, i.e. a set of points 
ai, . . . , ajv such that 

AC\J B{ai,e), 

i<N 

where B{a, e) = {y G S : d{a, y) < e} is a ball of radius e centered at a. Let us recall the following theorem 
from analysis. 
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Theorem 38 (Arzela-Ascoli) Let {S,d) be a compact metric space and let {C{S),doo) be the space of con- 
tinuous real-valued functions on S with uniform convergence metric 

doo{f,g) = sup|/(a;) - g{x)\. 
xes 

A subset T C C(5) is totally bounded in doc, metric iff is equicontinuous and uniformly bounded. 

Remark. Equicontinuous means that for any e > there exists 6 > such that if d{x, y) < 6 then for all 
/e^, \f{x)-fiy)\<e. 

Theorem 39 (Stone- Weierstrass) Let {S,d) be a compact metric space and C C'{S) is such that 

1. T is algebra, i.e. for all f,g & J^,c & M., we have cf + g & J^, fg G J^. 

2. T separates points, i.e. if x ^ y G S then there exists f G such that f{x) ^ f{y)- 

3. T contains constants. 
Then T is dense in C{S). 

Corollary 3 If{S,d) is a compact space then BL{S,d) is dense in C{S). 

Proof. For T = BL{S, d) in the Stone- Weierstrass theorem, 3 is obvious, 1 foUows from Lemma 32 and 2 
follows from the extension Theorem 37, since a function defined on two points x ^ y such that f{x) ^ f{y) 
can be extended to the entire S. 

□ 

Proof of Theorem 39. Consider bounded f & !F, i.e. |/(a;)| < M. A function x \x\ defined on the 
interval [— M, M] can be uniformly approximated by polynomials of x by the Weierstrass theorem on the 

real line or, for example, using Bernstein's polynomials. Therefore, can be uniformly approximated by 

polynomials of f{x), and by properties 1 and 3, by functions in JF. Therefore, if JF is the closure of JF in d^o 
norm then for any / e .F its absolute value |/| e .F. Therefore, for any f,gGf'we have 

min(/,5)=^(/ + 5)-^|/-5|eJF, niax(/,5) = ^(/ + 5) + ^|/ - 5I € jr. (I6.0.I) 

Given any points x ^ y and c, d € M one can always find f G T such that /(x) = c and /(y) = d. Indeed, by 
property 2 we can find g G T such that g{x) ^ g{y) and, as a result, a system of equations 

ag{x) + b= c, ag{y) + b = d 

has a solution a, b. Then the function f = ag + b satisfies the above and it is in .F by 1. 
Take h G C{S) and fix x. For any y let fyGThe such that 

fy{x) = h{x), fy{y) = h{y). 

By continuity of fy, for any y G S there exists an open neighborhood Uy of y such that 

fy{s) > h{s) — £ for s G Uy. 

Since (Uy) is an open cover of the compact S, there exists a finite subcover Uy^, . . . , Uy^. Let us define a 
function 

r (s) = max(/,,(s), . . . , fy,{s)) G T hy (16.0.1). 
By construction, it has the following properties: 

f''{x) = h{x), f''{s)>h{s)-e for all s G S. 
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Again, by continuity of /^(s) there exists an open neighborhood Ux of x such that 

r{s)<h{s)+e for seU^,. 
Take a finite subcover , U^^ and define 

/i'(s) ==min(r^(s),...,r''^(.s)) e J^by (16.0.1). 

By construction, h'{s) < h{s) + e and h'{s) > h{s) — £ for all s G S" which means that doo{h',h) < e. Since 
h' e this proves that is dense in C{S). 

□ 

Corollary 4 If {S,d) is a compact space then C{S) is separable in doo- 

Remark. Recall that this fact was used in the proof of the Selection Theorem, which was proved for 
general metric spaces. 

Proof. By the above theorem, BL{S, d) is dense in C{S). For any integer n > 1, the set {/ : ||/||bl < n} 

is uniformly bounded and equicontinuous. By the Arzela-Ascoli theorem, it is totally bounded and, therefore, 
separable which can be seen by taking finite l/m-covers for all m > 1. The union 

[jmWBT. <n} = BL{S,d) 

is therefore separable in C{S) which is, as a result, also separable. 

□ 
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